Bug 2059826 - Simplified View: Create checkbox selection for advanced columns and display how to read the results - #1069
Merged
Conversation
✅ Deploy Preview for mozilla-perfcompare ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
kala-moz
marked this pull request as draft
July 24, 2026 02:14
kala-moz
requested review from
beatrice-acasandrei,
esanuandra,
gmierz and
padenot
and removed request for
padenot
July 24, 2026 02:32
kala-moz
marked this pull request as ready for review
July 24, 2026 02:36
Contributor
|
It looks great! |
kala-moz
changed the title
kala-moz
force-pushed
the
simplified-view-phase1
branch
2 times, most recently
from
August 5, 2026 22:23
52293fe to
aada4b7
Compare
kala-moz
force-pushed
the
simplified-view-phase1
branch
from
August 6, 2026 21:28
6969361 to
1adf797
Compare
kala-moz
force-pushed
the
simplified-view-phase1
branch
from
August 17, 2026 21:51
1adf797 to
d235a20
Compare
Contributor
Author
|
Based on the feedback from today's sync, I will create a new row for the checkboxes so there's not so much white space in the table controls area |
beatrice-acasandrei
approved these changes
Aug 19, 2026
Contributor
Author
|
Hey @beatrice-acasandrei Thanks for the reviews! |
Update tests too Adjust styles for new table changes created toggle for customizing col: simple vs power view update tests to reflect new UI/UX add interpret results panel for simple users render 0.00 vs - for no data in median col update table to include significance; add difference below status update how to read the results Add an "Advanced columns" dropdown with independent Cliff's Delta and CLES Hidden by default; the choice persists to localStorage. Available on both the main and subtests pages. Persist advanced-column selection in the URL resolved PR review comments Add sortable/filterable Magnitude column and widen the results table
kala-moz
force-pushed
the
simplified-view-phase1
branch
from
August 20, 2026 00:13
458bd0a to
25841bf
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Deploy link
Bug 2059826
Summary
Introduces a beginner-friendly "simplified" results view for the Mann-Whitney-U comparison table, while keeping the full statistical detail only check-boxes away. New contributors get plain-language columns and an on-page reading guide by default; power users can reveal the advanced stats columns with specific checkboxes (persists in the url).
User-facing changes
Δ Median % (renamed from MD (%)) — now computed from the raw runs' medians ((median(new) − median(base)) / median(base) × 100), which matches both the expanded panel's bootstrap median-diff and the reference perfcompare-new-stats implementation. Formatted as a signed, 2-decimal percent (+1.08% / −2.40%); a warning icon flags non-normal distributions (the value is still shown, since the median is rank-based); shows +0.00% for a zero base median and - only when there are no runs.
Magnitude: Move the Cliff's Delta interpretation into its own "Magnitude" column (simplified view only) so users can sort and filter by effect size.
UPDATE: Significance is now a power-user column: hidden in the simplified view and toggled from the "Advanced columns" dropdown. To keep the noise signal visible by default, the Status cell shows a muted "Noise" pill above the direction chip for not-significant results, and the
Status filter gains a "Noise" option. The Noise filter value is mutually exclusive with the direction buckets: a noisy row belongs to "Noise" only, so unchecking Noise hides it and the Improvement/Regression/No change buckets match only real changes.
Advanced columns dropdown: contains independent Cliff's Delta, CLES, Significance checkboxes (either/both/neither).
"How to read the results" panel: A dismissive guide above the table explaining each column in plain English. Shown by default for new users; the close button or the "How to read the results" checkbox toggles it, and the choice is remembered.
Notable decisions / follow-ups
Defaults: simplified view and the reading panel are on by default (dismissible, remembered). Easy to flip if we'd rather not change the default for existing users.
Scope: the reading panel is on the main results view only (not the subtests drill-down) — easy to add there if wanted.
Phase 2 candidate: simplify the expanded row.
🤖 Generated with the help of Claude Code